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APPEAL BRIEF 

Mail Stop Appeal Brief - Patents 
Commissioner for Patents 
P.O. Box 1450 
Alexandria, VA 22313-1450 

Sir: 

This is an Appeal Brief under Rule 41.37 appealing the final decision of the Primary 
Examiner dated September 21, 2005. Each of the topics required by Rule 41,37 is presented 
herewith and is labeled appropriately. 

94/20/8886 TLOlll 888B887S 168813 89821648 
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L Real Party id Interest 

The real pajty in interest is Genex Technologies, Inc. of Maryland. The inventor has 
assigned all rights in the invention and the present application to Genex Technologies, Inc. 

II. Related Appeals and Interferences 

There are no appeals or interferences related to the present application of which the 
Appellants are aware. 

m. Status of Claims 

Claims 1-14 and 16-44 are currently pending in the application and all stand finally 
rejected. Claim 15 has been cancelled. Appellant appeals jfrom the final rejection of claims 
1-14 and 16-44, which claims are presented in the Appendix- 



IV. Status of Amendments 

On November 21, 2005, Appellant filed one response to the final Office Action 
mailed on September 2 1 , 2005. However, that response made no amendments to the 
application. Consequently, its entry into the record has no impact on the content of the claims 
presented on appeal. 

V. Summary of Claimed Subject Matter 

A number of approaches had been proposed for imaging systems that attempt to 
achieve a wide field-of-view (FOV). (Appellant's specification, paragraph 0003). Wide- 
viewing-angle lens systems, such as fish-eye lenses, are designed to have a very short focal 
length which, when used in place of conventional camera lens, enables the camera to view 

2 

PAGE 6(27 * RCVD AT W19/2O06 2:02:49 PM [Eastern Daylight Ti^^^ 



,04/19/206*6 12: 02 ' 18015727668 



RADER FISHMAN 



PAGE 07/27 



40169'-0031 097821^648 

objects at much wider angle to obtain a panoramic view, as shown in Figure 1 . In general, to 
widen the FOV, the design of the fish-eye lens is made more complicated. Moreover, the 
nonlinear properties resulting from the semi-spherical optical lens mapping make the 
resolution along the circular boundary of the image very poor. Although the images acquired 
by fish-eye lenses may be adequate for certain low-precision visualization applications, these 
lenses still do not provide adequate distortion compensation. (Appellant's specification, 
paragraph 0004). 

To dramatically increase the field of view of an imaging system. Appellant employs a 
reflective surface to obtain an omnidirectional image. In particular, the field of view of a 
video camera can be greatly increased by using a reflective surface with a properly designed 
surface shape that provides a greater field of view than a flat reflective surface. There are a 
number of surface profiles that can be used to produce an omxiidirectional FOV. (Appellant's 
specification, paragraph 0025). 

Figures 2a through 2c appear to indicate that any convex mirror can be used for 
omnidirectional imaging; however, a satisfactory imaging system must meet two 
requirements. First, the system must create a one-to-one geometric correspondence between 
pixels in an image and points in the scene. Second, the convex mirror should conform to a 
"single viewpoint constraint;" that is, each pixel in the image corresponds to a particular 
viewing direction defined by a ray from that pixel on an image plane through a single viewing 
point such that alj of the light rays are directed to a single virtual viewing point. Based on 
these two requirements, the convex mirrors shown in Figures 2a through 2c can increase the 
field of view but are not satisfactory imaging devices because the reflecting surfaces of the 
mirrors do not meet the single viewpoint constraint, which is desirable for a high-quality 
omnidirectional imaging system. (Appellant's specification, paragraph 0026). 
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The preferred design for a reflective surface is described with reference to Figure 3. 
Figure 3 shows a video camera 30 having an image plane 3 1 on which images are captured 
and a regular lens 32 whose field of view preferably covers the entire reflecting surface of the 
mirror 34. Since the optical design of camera 30 and lens 32 is rotationally syimnetric, only 
the cross-sectional fvmction z(r) defining the mirror surface cross-section profile needs to be 
determined. The actual mirror shape is generated by the revolution of the desired cross- 
section profile about its optical axis. The function of the mirror 34 is to reflect all viewing 
rays coming from the video camera's 30 focal point C to the surface of physical objects in the 
field of view. A hyperbola is the preferred cro3S-sectional shape of the mirror 34 because a 
hyperbolic mirror will satisfy the geometric correspondence and single viewpoint constraint 
reqiiirements of the system. (Appellant's specification, paragraph 0027-8). 

The image obtained by the camera 30 and capture on the camera*s image plane 3 1 will 
exhibit some distortion due to the non-planar reflecting surface of the mirror 34, To facilitate 
the real-time processing of the omnidirectional image, the inventive system uses an algorithm 
to map the pixels from the distorted omnidirectional image on the camera's image plane 3 1 
onto a perspective window image 40 directly, once the configuration of the perspective or 
panoramic window is defiuaed. As shown in Figure 4, a virtual perspective viewing window 
40 can be arbitrarily defined in a three-dimensional space using three parameters: Zoom, Pan 
and Tilt, All of these parameters can be adjusted by the user. (Appellant's specification, 
paragraph 0030). 

Once the perspective viewing window W 40 is defined, the system can establish a 
mapping matrix that relates the pixels in the distorted omnidirectional image I(i j) to pixels 
W(p,q) in the user-defined perspective viewing window W 40 to fonn a non-distorted 
perspective image. The conversion from the distorted omnidirectional image into a non- 
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distorted perspective image using a one-to-one pixel correspondence between the two images 
is unique. (Appellant's specification, paragraph 0031). 

Once the mapping matrix MAP has been established, the real-time image-processing 
task is greatly simplified and can be conducted in a single step at step 70 by applying the 
mapping matrix MAP to each pixel I(iJ) in tlie omnidirectional image I to determine the pixel 
values for each corresponding pixel in the perspective viewing window W. Further, each 
time a new omnidirectional image I is acquired, a look-up table operation can be performed to 
generate the non*distorted perspective image for display in the perspective viewing window 
W at step 72. (Appellant's specification, paragraph 0036), 

VI, Grounds of Rejection to be Reviewed on Appeal 

In the jSnal Office Action, the following rejections were made for which review is 
requested by this appeal. 

(1) Claims 1-6 were rejected as unpatentable under 35 U.S.C. § 103(a) in view of the 
combined teachings of U.S. Patent No. 6,1 18,474 to Nayar ("Nayar") and U.S. Patent No. 
5,870,135 to Glatt et al. ("Glatf 

(2) Claims 14 and. 16-23 were rejected as being unpatentable under 35 U.S.C. § 103(a) 
in view of the combined teachings of Nayar and U.S. Patent No. 4,908,874 to Gabriel 
("GabrierO. 

(3) Claims 31-38 and 44 were rejected as unpatentable under 35 U.S.C. § 103(a) over 
the combined teachings of Nayar, Gabriel and U.S. Patent No., 6,226,035 to Korein et al. 
("Korein")- 
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(4) Dependent claims 7-9 were rejected under 35 U.S.C. § 103(a) over the combined 
teachings of Nayar and U.S. Patent No. 5,790>181 to Chahl et al ("Chahl") and U,S, Patent 
No, 3,988,533 to Mick et al. C'Mick'O- 

(5) Dependent claims 10-13 were rejected under 35 U.S.C. § 103(a) over the 
combined teachings of Nayar, Glatt and U,S. Patent No. 5.686,975 to Baker ("Baker"). 

(6) Dependent claims 24 and 25 were rejected under 35 U.S.C* § 103(a) over the 
combined teachings of Nayar, Gabriel, Chahl and Mick. 

(7) Dependent claims 26-29 were rejected under 35 U.S.C. § 103(a) over the 
combined teachings of Nayar^ Gabriel, and Baker. 

(8) Dependent claim 39 and 40 were rejected as unpatentable under 35 U.S.C. § 
103(a) over the combined teachings of Nayar, Gabriel, Korein, Chahl and Mick. 

(9) Dependent claim 41-43 were rejected as unpatentable under 35 U,S.C. § 103(a) 
over the combined teachings of Nayar, Gabriel, Korein, and Baker. 

VIL Argument 

Claim 1: 

Claims 1-6 were rejected as unpatentable under 35 U.S.C. § 103(a) in view of the 
combined teachings of U.S. Patent No. 6,1 18,474 to Nayar ("Nayar'') and U.S. Patent No. 
5,870,135 to Glatt et al ("Glatt"). 

Claim 1 recites: 

A method for generating a selectable perspective view of a portion of a 
hemispherical image scene, comprising the steps of: 

acquiring an omnidirectional image on an image plane using a reflective 
mirror that satisfies a single viewpoint constraint and an image sensor; 

defining a perspective viewing window based on configuration parameters; 

and 
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mapping each pixel in the perspective window with a corresponding pixel 
value in tlie omnidirectional image on the image plane using a look-up table based on 
the configuration parameters. 

Nayar is cited because Nayar teaches the collection of a wide-angle image iising 
a truncated, substantially paraboloid-shaped reflector." (Nayar, abstract). However, in 
/contrast to claim 1 , Nayar fails to teach or suggest the claimed mapping of pixels firom an 
omnidirectional image to a perspective viewing window "using a look-up table." The recent 
Office Action concedes this point (Action of 9/21/05, p. 2, "Nayar is lacking the use of look- 
up tables for the mapping.") 

Consequently, the Office Action proposed to combine the teachings of Glatt with 
Nayar. According to the Office Action, "Glatt teaches the mapping firom a fish-eye lens 
(which is hemispherical) to cartesian coordinates using a look-up table." (Action of 9/21/05, 
p. 2). Glatt describes in detail the equations that are used to map the image fi-om the fish-eye 
lens. (Glatt, coL 7, line 46 to col. 8, line 43). Glatt, however, does not teach or suggest how 
mapping would be perfonned using a look-up table for an image that comes, not firom a fish- 
eye lens, but firom a reflective miiror as claimed. 

The mapping fimction of Glatt cannot be imported into the system taught by Nayar 
because Nayar does not operate on an image produced with a fish-eye lens. The vast 
differences between the use of a mirror, and a fish-eye lens and the problems associated with . 
the use of a fish-eye lens are documented in Appellant's specification at, for example, 
paragraph 0004 as noted in the Summary of Claimed Subject Matter above. . 

"An analysis of obviousness of a claimed combination must include consideration of 
the results achieved by that combination." Gillette Co, v, S, C Johnson & Son, Inc., 91 9 F.2d 
720 (Fed. Cin 1 990)' "If the proposed modification or combiuation of the prior art would 
change the principle of operation of the prior art invention being modified, then the teachings 
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of the references are not sujEficient to render the claims prima facie obvious. In re Ratti, 270 
F.2d 810, 123 USPQ 349 (CCPA 1959)/' M.P.E.P, § 2143,01. 

More importantly, "[i]n order to render a claimed apparatus or method obvious, the 
prior art must enable one skilled in the art to make and use the apparatus or method." 
Bcckmm Instruments, Inc, v. LKB Produkter AB, 892 F.2d 1547, 1551, 13 U.S.P.Q.2d 1301, 
1304 (Fed. Cir. 1989); In re Payne, 606 F.2d 303, 314, 203 US.P.Q. 245, 255 (CCPA 1979), 
In the present case, the teachings of Nayar and Glatt, even if combined, do not enable one of 
skill in the art to make and use the claimed method in which a look-up table is used to map an 
image from a reflective miixor, rather than from a fish-eye lens. 

For any and all of these reasons, the teachings of Nayar and Glatt fail to enable or 
render obvious the subject matter of claim 1. Therefore, the rejection of claim 1 and its 
dependent claims based on Nayar and Glatt should not be sustained. 

Claim 2. 3, 18. 19, 34 and 35: 

The various dependent claims in the application recite further subject matter that is 

not taught or suggested by the prior art of record. For example, claim 2 recites: 

wherein the configuration parameters defined in the defining step include at least one 
of a zoom distance defined as the distance from the focal point of said reflective 
mirror to said window, a pan angle defined as the angle between the x axis and a line 
through the focal point of said reflective mirror perpendicular to the x-y plane and a 
tilt angle defined as the angle between the x-y plane and a vector normal to said 
window. 

Claims 18 and 34 recite similar subject matter- 
In contrast, Nayar and Glatt fail to teach or suggest the claimed configuration 
parameters includmg a zoom distance defined as the distance fi-om the focal point of a 

8 
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reflective mirror to a user-defined window, a pm angle and tilt angle as claimed. For at least 
this additional reason, the rejection of claims 2, 3, 18, 19, 34 and 35 should not be sustained. 

Claims 4, 5, 20 and 36: 

Claim 4 recites: 

wherein the mapping step includes the step of generating a mapping matrix by: 
applying a ray tracing algorithm to each pixel in the perspective viewing 

window to determine a corresponding reflection point on the reflective mirror; and 
projecting each reflection point to a focal point of the image sensor to 

determine tlic corresponding location in the omnidirectional image on the image 

plane. 

Claims 20 and 36 recite similar subject matter. 

hi contrast, Nayar and Glatt, as demonstrated above, teach mapping from a fish-eye 
lens. Consequently, Nayar and Glatt cannot and do not teach or suggest a method having a 
mapping step that includes applying a ray tracing algorithm to each pixel in the perspective 
viewing window to deteimine a corresponding reflection point on the reflective mirror as 
claimed. For at least this additional reason^ the rejection of claims 4, 5, 30 and 36 should not 
be sustained. 

Claims 14, 16-23. 31-38 and 44: 

Claims 14, 16-23, 31-38 and 44 were rejected as being unpatentable under 35 U.S.C. 
§ 103(a) in view of the combined teachings of Nayar and U.S. Patent No. 4,908,874 to 
Gabriel ("Gabrier*). For at least the following reasons, this rejection is respectfully traversed. 

Claim 14 recites; 

An improved imaging apparatus for generating a two-dimemional image, 
comprising: 

a reflective mirror configured to satisfy an optical single viewpoint constraint 
for reflecting an image scene; 
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an image sensor responsive to said reflective mirror and that generates two 
dimensional image data signals to obtain an omnidirectional in^age on an image plane; 
and 

a controller coupled to the image sensor, wherein the controller defines a 
perspective viewing window based on configuration parameters and maps pixels from 
said omnidirectional image into said perspective viewing window; and 

a memory for storing a mapping matrix for each of a plurality of sets of said 
configuration parameters in a parameter space, said controller using a said mapping 
matrix to perform mapping of pixels from said omnidirectional image into said 
perspective viewing window, 
(emphasis added). 

Claims 31-38 and 44 were rejected as unpatentable under 35 U.S.C. § 103(a) over the 
combined teachings of Nayar^ Gabriel and U.S. Patent No., 6,226,035 to Korein et al. 
("Korein"). 

Similar to claim 14, claim 31 recites: 

An imaging apparatus for generating a two-dimensional image, comprising: 
a reflective hyperbolic mirror having a hyperbolic cross-section; 
an image sensor optically coupled to said reflective mirror that generates two- 
dimensional image data signals based on an omnidirectional image reflected by said 
mirror; and 

a controUer coupled to the image sensor, wherein the controller defines a 
perspective viewing window based on cotifiguration parameters and maps pixels from 
said omnidirectional image into said perspective viewing window; and 

a memory for storing a mapping matrix for each of a plurality of sets of said 
configuration parameters in a parameter space, said controller using a said mapping 
matrix to perform mapping of pixels firom said omnidirectional image into said 
perspective viewing window. 

As conceded in the Office Action, "Nayar does not specifically teach the memory for 
storing a mapping matrix for each of a plurality of sets of said configuration parameters in 
parameter space/' (Action of 9/21/05, p. 10). Consequently, the Office Action cites to 
Gabriel, which allegedly teaches *'the use of matrices to perform transfoimations such as 
translation, contraction, expansion rotation and perspective projection." (Id.), Apphcant 
respectfully submits that even if this interpretation of Gabriel's teachings is accurate, it is 
insufficient to support a rejection of claim 14. 
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Gabriel does not teach or suggest "a memory for storing a mapping matrix each of 
a plurality of sets of said configuration parameters in a parameter space" The Office 
Action fails to indicate how or where Gabriel or any other cited prior art reference teaches or 
suggests a memory storing a mapping matrix for each of a plurality of sets of configuration 
parameters. The final Office Action does not even expressly allege that Gabriel teaches this 
sub] ect matter. 

Moreover, the Office Action states that the teachings of Gabriel are applicable 'to 
perform complex warping of images such as to a fish-eye image." (Action of 9/21/05, p. 3). 
As demonstrated above, this further proves the inapphcability of the teachings of Gabriel to 
claim \% which calls for a method using an omidirectional image acquired with a "reflective 
mirror.'* The teachings of Gabriel cannot be applied to a method in which mapping is 
perfonned u^ing an image from a reflective mirror rather than a fish-eye lens. 

"To establish prima facie obviousness of a claimed invention, all the claim limitations 
must be taught or suggested by the prior art. In re Royka, 490 F.2d 98 1 , 1 80 USPQ 5 80 
(CCPA 1974)." M.P.RP. § 2143.03. Accord, M.P.E.P. § 706.020)- For at least these 
reasons, the rejection of claim 14 and its dependent claims and claims 31-38 and 44 should 
not be sustained. 

Claim 38: 

Claim 38 recites; "The imaging apparatus of claim 31, wherein said memory contains 
a predetermined mapping matrix for every set of configuration parameters in said parameter 
space/' In contrast, the combination of Nayar, Gabriel and Korein fails to teach or suggest 
the claimed memory containing a predetermrned mapping matrix for every set of 
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configuration parameters in a parameter space. For at least this additional reason, the 
rejection of claim 38 should not be sustained. 

In view of the foregoing, it is submitted that the jEinal rejection of the pending claims 
is improper and should not be sustained. Therefore, a reversal of the Final Rejection of 
September 2 1 , 2005 is respectftilly requested. 



Steven L. Nichols, Esq. 
Managing Partner, Utali Office 
Radei" Fishinan & Grauer PLLC 
River Park Corporate Center One 
10653 S. River Front Parkway, Suite 150 
South Jordan, Utah 84095 
(801) 572-8066 
(801) 572-7666 (fax) 



Respectfully submitted, 



DATE: Aprin9,2006 




Steven L. Nichols 
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Vin, CLAIMS APPENDIX 



1. (previously presented) A method for generating a selectable perspective view 
of a portion of a hemispherical image scene, comprising the steps of: 

acquiiing an omnidirectional image on an image plane using a reflective mirror that 
satisfies a single viewpoint constraint and an image sensor; 

definitxg a perspective viewing window based on configuration parameters; ajnd 

mapping each pixel in the perspective vraidow with a corresponding pixel value in the 
omnidirectional image on the image plane using a look-up table based on the configuration 

l/UA. CUUlJlVl.V'l O . 

2 . (original) The method o f claim 1 , wherein the configuration parameters 
defined in the defining step include at least one of a zoom distance defined as the distance 
from the focal point of said reflective mirror to said window, a pan angle defmed as the angle 
between the x axis and a line through the focal point of said reflective tnirror perpendicular to 
the x-y plane and a tilt angle defined as the angle between the x-y plane and a vector normal 
to said window, 

3. (original) The method of claim 2, wherein the defining step is conducted 
via a user interface through which a user enters data corresponding to at least one of a desired 
zoom distance, pan angle, or tilt angle. 

4. (original) The method of claim 1, wherein the mapping step includes the 
step of generating a mapping matrix by: 
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applying a ray tracing algorithm to each pixel in the perspective viewing window to 
determine a corresponding rejQection point on the reflective mirror; and 

projecting each reflection point to a focal point of the image sensor to determine the 
corresponding location in the omnidirectional image on the image plane. 

5. (original) The method of claim 4, further comprising the step of storing 
the mapping matrix in a module having a memory, 

6. (original) The method of claim 1 wherein the step of dejfining a 
perspective ^'iev/ing window defines the perspective viewing window as a panoramic viewing 
window, 

7. (original) The method of claim 1, further comprising the steps of: 
calculating a residual image based on a difference between a reference 

omnidirectional image and a sequential omnidirectional image; 

determining if the residual image contains any value that exceeds a predetermined 
tlxreshold; and 

classifying any value that exceeds the predetermined threshold as an anomaly. 

8. (original) The method of claim 7, further comprising the steps of 
calculating the configuration parameters for the perspective viewing window firom the 

anomaly; and 

selectively focusing the perspective viewing window on the anomaly using the 
calculated configuration parameters. 
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9. (original) The method of claim 7, further comprising the step of 
activating sjx alarm if at least a portion of the residual image exceeds a predetemained 
threshold. 

10. (original) The method of claim 1 , fiirther comprising the steps of: 
detecting a location of a sound source in the image scene; and 

adjusting the perspective vicAving window based on the detected location of the sound 

source. 

• 11. . (original) The method of claim 1 , further comprising the step of 
transmitting the omnidirectional image via the Internet. 

12. (original) The method of claim 11, wherein the transmitting Step is 
conducted through a server that receives the omnidirectional image and transmits the 
omnidirectional image to at least one clieait. 

1 3 . (original) Tlie method of claim 1 , further comprising the step of forming a 
two-way transmission link between the image sensor and a remote display, wherein the two- 
way transmission link transmits at least one of the omnidirectional image, the perspective 
viewing window, and an audio signal. 

14. (previously presented) An improved imaging apparatus for generating a two- 
dimensional image, comprising: 
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a rejflective minror configured to' satisfy an optical sijQgle viewpoint constraint for 
reflecting an inxage scene; 

an image sensor responsive to said reflective miiTor and that generates two 
dimensional image data signals to obtain an omnidirectional image on an image plane; and 

a controller coupled to the image sensor, wherein the controller defines a perspective 
viewing window based on configuration parameters and maps pixels fi-om said 
omnidirectional image into said perspective viewing window; and 

a memory for storing a mapping matrix for each of a pluraKty of sets of said 
configuration parameters in a parameter space, said controUei' using a said mapping matrix to 
perfoxTxi mapping of pixels from said omnidirectional image into said perspective viewing 
window.. 

15. (cancelled). 

16- (original) The improved imaging apparatus of claim 14, wherein the 
reflective mirror creates a one-to-one correspondence between pixels in the omnidirectional 
image and pixels in the perspective viewing window. 



17. (original) The improved imaging apparatus of claim 14, wherein the 
conh-oUer maps the omnidirectional image to the perspective viewing window by mapping 
each pixel in the perspective viewing window with a corresponding pixel value in the 
omnidirectional image. 
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1 8. (original) The improved imaging apparatus of claim 14> wherein the 
parameters defiiiing the perspective viewing window include at least one of a zoom distance 
defined as the distance from the focal point of said reflective mirror to said window, a pan 
angle defined as the angle between the x axis and a line through the focal point of said 
reflective .mirror perpendicular to the x-y plane and a tilt angle defined as the angle between 
tlie x-y plane and a vector normal to the perspective viewing window. 

19. (original) The improved imaging apparatus of claim 1 8, further 
comprising a user interface through which a user enters data corresponding to at least one of a 
desired zoom distance, pan angle, or tilt angle. 



20. (previously presented) The improved imaging apparatus of claim 14, wherein 
tlie controller generates a mapping matrix by applying a ray tracing algorithm to each pixel in 
the perspective viewing window to determine a corresponding reflection point on the 
reflective mirror and then projecting each reflection point to a focal point of the image sensor 
to detemiine the corresponding location on the omnidirectional image. 

2 1 . (original) The improved imaging apparatus of claim 1 4, wherein the 
perspective viewing window is a panoramic viewing window. 

22. (previously presented) The improved imaging apparatus of claim 14, further 
comprising a module having a memory for storing a mapping matrix. 
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23. (original) The improved imaging apparatus of claim 22, whereii] the 
module is a display/memory/local control module. 

24. (original) The improved imaging apparatus of claim 14, wherein the 
controller calculates a residual image based on a difference between a reference 
omxudirectional image and a sequential omnidirectional image to detect an anomady and uses 
the anomaly to calculate parameters for the perspective viewing window so that the 
perspective viewing window focuses on the anomaly. 

25. (original) Tlie ijriproved imaging apparatus of claim 24, further 
comprising an alarm that is activated if at least a portion of the residual image exceeds a 
predetermined threshold. 

26. (oiiginal) The improved imaging apparatus of claim 14, further 
comprising an acoustic sensor coupled to the controller for detecting a sound source within 
the image scene, wherein the controller adjusts the perspective viewing window based on a 
location of the sound source. 

27. (original) The improved imaging apparatus of claim 14, further 
comprising an image transmission system for transmitting the omnidirectional image via the 
hitemet. 
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28. (original) The improved imaging apparatus of claim 27, wherein the 
image transmission device includes a server that receives the omnidirectional image and 
transmits the omnidirectional image to at least one client. 

29. (previously presented) The improved imaging apparatus of claim 1 4, further 
comprising: 

a remote display coupled to the image sensor; 

a first speaker and jSrst microphone coupled to the image sensor; and 
a second speaker and second microphone coupled to the remote display, wherein the first and 
second speakers and first and second microphones form a two-way transmission link between 
the image sensor and the remote display. 

30. (previously presented) The improved imaging apparatus of claim 14, wherein 
said reflective mirror is a hyperbolic mirror having a hyperbohc cross-section, 

3 1 . (previously presented) An imaging apparatus for generating a two-dimensional 
image, comprising: 

a reflective hyperbolic mirror having a hyperbolic cross-section; 

an image sensor optically coupled to said reflective mirror that generates two- 
dimensional image data signals based on an omnidirectional image reflected by said mirror; 
and 

a controller coupled to the image sensor, wherein the controller defmes a perspective 
viewing window based on configuration parameters and maps pixels jfrom said 
omnidirectional image into said perspective viewing window; and 
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a memoty for storing a mapping matrix for each of a plurality of set$ of said 
configuration parameters in a parameter space, said controller using a said mapping matrix to 
perform mapping of pixels from said omnidirectional image into said perspective viewing 
window. 

32 . (previously presented) The imaging apparatus of claim 3 1 , wherein the 
reflective mirror creates a one-to-one correspondence between pixels in the omnidirectional 
image and pixels in the perspective viewing window. 

33. (previously presented) The imaging apparatus of claim 31, wherein the 
controller maps the omnidirectional image to the perspective viewing window by mapping 
each pixel in the perspective viewing window with a corresponding pixel value in the 
omnidirectional image. 

34. (previously presented) The imaging apparatus of claim 14, wherein parameters 
dejSiung the perspective viewing window include at least one of a zoom distance dejSned as 
the distance from the focal point of said reflective mirror to said window^ a pan angle defined 
as the angle between the x axis and a hne through the focal point of said reflective mirror 
perpendicular to th& x-y plane and a tilt angle defined as the angle between the x-y plane and 
a vector normal to the perspective viewing window. 

35. (previously presented) The imaging apparatus of claim 34, further comprising a 
user interface through which a user enters data corresponding to at least one of a desired 
zoom distance, pan angle^ or tilt angle. 
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36. (previously presented) The imaging apparatus of claim 3 1 , wherein the 
controller generates a mapping matrix by applying a ray tracing algorithm to each pixel in the 
perspective viewing window to determine a corresponding reflection point on the reflective 
mirror and then projecting each reflection point to a focal point of the image sensor to 
deteraiine the corresponding location on the omnidirectional image. 

37. (previously presented) The imaging apparatus of claim 31, wherein the 
perspective viewing window is a panoramic viewing window. 

38. (previously presented) The imaging apparatus of claim 3 1 , wherein said 
memory contains a predetertnined mapping matrix for every set of configuration parameters 
in said parameter space. 

39. (previously presented) The imaging apparatus of claim 3 1 , wherein the 
controller calculates a residual image based on a difference between a reference 
omnidirectional image and a sequential omnidirectional image to detect an anomaly and uses 
the anomaly to calculate parameters for the perspective viewing window so that the 
perspective viewing window focuses on the anomaly. 

40. (previously presented) The imaging apparatus of claim 39, further comprising 
an alaim that is activated if at least a portion of the residual image exceeds a predetermined 
threshold. 
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4 1 . (previously presented) The imaging apparatus of claim 3 1 , further comprising 
an acoustic sensor coupled to the controller for detecting a sound source within a scene of 
said omnidirectional image reflected by said mirror^ wherein the controller adjusts the 
perspective viewing window based on a location of the sound source. 

42. (previously presented) The imaging apparatus of claim 3 1 , further comprising 
an image transmission system for transmitting image output by said image sensor via the 
Jhtemet. 

43. (previously presented) The imaging apparatus of claim 31, further comprising: 
a remote display coupled to the image sensor; 

a first speaker and first microphone coupled to the image sensor; and 
a second speaker and second microphone coupled to the remote display, 
wherein the first and second speakers and first and second microphones form a two- 
way transmission link between the image sensor and the remote display. 

44. (previously presented) The imaging apparatus of claim 3 1 , wherein 

each said mapping matrix is configured to reduce distortion during mapping of each 
pixel in the perspective viewing window with a corresponding pixel from said 
omnidirectional image. 
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None 



None 



None 



IX> Evidence Appendix 



X- Related Proceedings Appendix 



XI. Certificate of Service 
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